A computer-aided environment for generating multiple-choice test items
نویسندگان
چکیده
This paper describes a novel computer-aided procedure for generating multiple-choice test items from electronic documents. In addition to employing various Natural Language Processing techniques, including shallow parsing, automatic term extraction, sentence transformation and computing of semantic distance, the system makes use of language resources such as corpora and ontologies. It identifies important concepts in the text and generates questions about these concepts as well as multiple-choice distractors, offering the user the option to post-edit the test items by means of a user-friendly interface. In assisting test developers to produce items in a fast and expedient manner without compromising quality, the tool saves both time and production costs.
منابع مشابه
The Effects of Presenting Multiple-Choice Test Items in Oral and Written Modes and Item Types on Advanced EFL Learners’ Listening Comprehension and Perception
This quasi-experimental study aimed to compare the effect of different modes and item types of multiple-choice (MC) test items on advanced EFL learners’ listening comprehension and perception. To this end, 80 advanced EFL learners, aging 18 to 30, were selected. The participants took a listening test including dialogue-completion and question and answer multiple-choice items presented in writte...
متن کاملGenerating Multiple-Choice Test Items from Medical Text: A Pilot Study
We report the results of a pilot study on generating Multiple-Choice Test Items from medical text and discuss the main tasks involved in this process and how our system was evaluated by domain experts.
متن کاملUtility of Complex Alternatives in Multiple-Choice Items: The Case of All of the Above
This study investigated the utility of all of the above (AOTA) as a test option in multiple-choice items. It aimed at estimating item fit, item difficulty, item discrimination, and guess factor of such a choice. Five reading passages of the Key English Test (KET, 2010) were adapted. The test was reconstructed in 2 parallel forms: Test 1 did not include the abovementioned alternative, whereas Te...
متن کاملNew Issues and Solutions in Computer-aided Design of MCTI and Distractor Selection for Bulgarian
We describe a methodology for improving the generation of multiple-choice test items through the usage of language technologies. We apply common natural language processing techniques, like constituency parsing and automatic term extraction together with additional morphosyntactic rules on raw instructional material in order to determine its key terms. These key terms are then used for the crea...
متن کاملBootstrapping Multiple-Choice Tests with The-Mentor
It is very likely that, at least once in their lifetime, everyone has answered a multiple-choice test. Multiple-choice tests are considered an effective technique for knowledge assessment, requiring a short response time and with the possibility of covering a broad set of topics. Nevertheless, when it comes to their creation, it can be a time-consuming and labour-intensive task. Here, the gener...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Natural Language Engineering
دوره 12 شماره
صفحات -
تاریخ انتشار 2006